Dynamic Load Balancing in a Message Passing Virtual Parallel Machine Dynamic Load Balancing in a Message Passing Virtual Parallel Machine

In this paper we will look into the problem of dynamic balancing of tasks in a het-erogenous parallel computing environment. The parallel programs are assumed to be executed in the Single Program Multiple Data (SPMD) style. The criteria for re-balancing the load are discussed; the eeect of data movement required in the load balancing is considered; and novel algorithms of dynamic load balancing are proposed. To study the behaviour of the algorithms under various conditions, simulation has been conducted, and the results have been analysed.